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Abstract 

We address the problem of obtaining well-defined criteria for multiob- 
jective optimal control systems. Necessary and sufficient conditions for 
an optimal control functional to be nonessential are proved. The results 
provide effective tools for determining nonessential objectives in vector- 
valued optimal control problems. 
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1 Introduction 

Multiobjective optimal control attracts more and more attention and is source of 
strong current research (see e.g. POEIEII and references therein). We consider 
multiobjective problems of optimal control governed by ordinary differential 
dynamical systems. This comprises an important class of problems which natu- 
rally appear on practical applications to Economic |131 Chap. 8] and Engineering 
modelling |17| . Our main goal is to extend the results found in the literature on 
nonessential functions of mathematical static optimization programming [SJ IT2] 
to functionals of optimal control theory. 

•Research Report CM06/I-33. Presented at the 5th Junior European Meeting on Control 
& Information Technology (JEM'06), September 20-22, 2006, Tallinn, Estonia. 
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It is well known that the concept of Pareto optimality or efficiency play a 
crucial role on optimal control El ■ The question of obtaining well-defined 
criteria for multiple criteria decision making problems seems, however, being 
considered in the literature only for static multiobjective optimization problems 
(cf. |SJ E] and references therein) . In this work we investigate the problem 
of obtaining well-defined criteria for multicriteria optimal control dynamical 
systems. 

One of the approaches dealing with the problem of obtaining well-defined 
criteria for multiple criteria static decision making problems is the concept of 
nonessential objective functions. A certain objective function is called nonessen- 
tial if it does not influence the set of efficient solutions of the vector-valued 
optimization problem, that is, the set of efficient solutions is the same both 
with or without that objective function. Information about nonessential ob- 
jectives helps a decision maker to know and to understand better the problem 
and this might be a good starting point for further investigation or revision of 
the mathematical model. Dropping nonessential functions leads to a problem 
with a smaller number of objectives, which can be solved more easily. For this 
reason, the issue of nonessential objectives is a substantial feature for multi- 
ple criteria decision making pi HjJ To the best of the authors knowledge, 
no study has been done in this field for optimal control problems. We are in- 
terested in generalizing the previous results on nonessential objectives found 
in the literature to cover optimal control problems with a vector-valued func- 
tional to minimize. More precisely, we generalize the concept of nonessential 
objective to multicriteria functionals of optimal control systems and we give the 
first steps on the corresponding theory. Main results provide methods for iden- 
tifying nonessential objectives in nonlinear and optimal control vector-valued 
optimization problems. 

2 Optimal control with a vector-valued cost 

We consider a dynamical control system described by n state variables x — 
(xi, . . . , x n ) G W 1 and r control variables u = [u\, . . . , u r ) € W ', r < n. Both 
state and control variables vary with respect to the scalar variable tGl. Given 
a control vector function u : [a, b] — > W, the state evolution over [a, 6], namely 
x : [a, b] — > R™, must satisfy the control system 

x(t) = h(t,x(t),u(t)), (2.1) 

the boundary conditions 

x(a)=a, x(b)=f3, (2.2) 

and to inequality constraints 

gi (t,x(t),u(t))<0, i = l,...m. (2.3) 

We would like to find a piecewise-continuous control function u(-) and the corre- 
sponding state trajectory x(-), satisfying l|2.1|l . I|2.2|) and l|2.3|l . which minimizes 
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a finite number N of cost functional, called the optimal control multiobjective 
criteria or an optimal control multiobjective performance-index: 



pb I pb pb \ 

min / f(t, x(t), u{t))dt = min I / fi(t, x(t), u(t))dt, • ■ • , / fff(t,x(t),u(t))dt 

J a \J a J a , 

All functions f(t,x,u), g(t,x,u) and h(t,x,u) are assumed to be continuously 
differentiable with respect to t and x variables. To simplify notation, we write 

I N [x,u] = / f(t,x(t),u{t))dt 

J a 

and 

I i [x,u}= I Mt,x(t),u{t))dt, i = l,...,N. 

J a 

In general does not exist a pair of functions (x, u) that renders the minimum 
value to each cost functional Jj , i = 1 , . . . , N, simultaneously, and one uses 
the concept of Pareto-optimality. Let us denote by S the set of feasible solu- 
tions, i.e. the set of all admissible functions (x,u). The multiobjective control 
problem consists to find all feasible solutions that are efficient in the sense of 
Definition 12. II This problem is denoted in the sequel by (P). We remark that 
many practical applications that appear in engineering and economics can be 
written in the form of problem (P) |17| . 

Definition 2.1 (Pareto-optimality). A pair of functions (x,u) G S is said 
to be an efficient (Pareto-optimal) solution of the problem (P) if, and only if, 
there exists no (x, u) G S such that I N [x, u] ^ P^lx, u], where 

I N [x,u] <, I N [x,u] 

<&Vi€ {1,...,N} : Ii[x,u] ^ Ii[x,u] A 3j £ {1, . . . , N} : Ij[x,u] < Ij[x,u] ■ 
The set of efficient solutions of (P) is denoted by . 

The central result in optimal control theory is given by the celebrated Pon- 
tryagin maximum principle ,15' , which is a necessary optimality condition. A 
version of the Pontryagin maximum principle for Pareto-solutions of control 
systems with multiple criteria was proved already in the sixties p . Roughly 
speaking, one can say that the necessary and sufficient conditions for Pareto- 
optimality are obtained converting the vector performance optimal control prob- 
lem to a family of scalar-index optimal control problems by forming an auxiliary 
scalar integral functional as a function of the vector- index and a vector of weight- 
ing parameters |U1 116j. For a gentle introduction to optimal control, including 
necessary and sufficient conditions and the question of existence, we refer the 
readers to ^3 (scalar case) and [SJEI (Pareto optimal control). Here we 
just recall three basic lemmas (cf. (SJ Chap. 17]) that relate the Pareto-solution 
of a multiobjective control problem with the solutions of an appropriate scalar- 
valued cost problem. 
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Lemma 2.2. If the feasible pair (x,u) € S is efficient for (P), then it is optimal 
for the scalar-valued cost 

Ii[x,u], ie{l,...,N} 

subject to the constraints (x, u) G S and 

Ij [x, u] — Ij [x , u] < , j = 1, . . . , N and j ^ % . 

Lemma 12.21 is very useful because it implies that the necessary conditions 
01 115j are also necessary for Pareto-optimality in the optimal control problem 
with a vector- valued cost. As with the necessary conditions, next two lemmas 
reduce the sufficient conditions for Pareto-optimality to sufficient conditions 
with a scalar-valued cost functional. 

Lemma 2.3. A feasible pair (x, u) G S is efficient for (P) if there exists a 
constant 7 G 18L N , with 7$ > for i = 1, . . . , N and Y^t=i 7< = 1> such that 

N N 

[x,u\ jib [z> w] 

i=l i=l 

/or every (x,m) G 5. 

Unlike Lemma f2. 31 not all components of 7 in the next Lemma \'2 . 41 need to 
be nonzero. However, in Lemma |2.4I the minimum of $^_i7iii[afj it] must be 
achieved by a unique (x, u) G S. 

Lemma 2.4. A feasible pair (x, u) G S is efficient for (P) if there exists a 
constant 7 G M. , with 7,; > for i — 1, . . . , N and X)i=i li = ^-> suc h that 

N N 

^2 lA [ x , u ] lib [*) W] 

i=l i=l 

/or every (x,it) G S 1 , (x, u) 7^ (x, u). 

Together with the Pontryagin maximum principle I15| , Lemmas 12.21 12.31 
and 12.41 provide expedient tools to study concrete multiobjective problems of 
optimal control (cf. 2J). 

3 Nonessential functionals: main results 

We form a new multiobjective control problem (P) from (P) by adding a new 
functional In+i[x,u] — J fN+i{t,x{t),u{t))dt to problem (P). Let S^ +1 de- 
note the set of efficient solutions of the problem (P). With this notation we 
introduce the definition of nonessential functional. 
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Definition 3.1. The functional ijv+i is sa id to be nonessential in (P) if, and 
only if, — S^ +1 . A functional which is not nonessential will be called 
essential. 

We are interested in characterizing the functionals which do not change the 
set of efficient solutions (nonessential objective functionals). Along the text we 
denote by Si, i — 1, 2, . . . , N, N + 1, the set of solutions of the scalar optimal 
control problem 

minij[ir, u] 

subject to S. We start with a simple example. 

Example 3.2. Consider a system characterized by a single state and control 
variable {n = r = 1) that evolves according to the state equation 

±(t) = u(t) 

with control constraint set 

U = {u : [a,b] -> E : \u(t)\ < 1}. 

The system is to be transferred from a given initial state x(0) = £ 7^ to a 
given terminal state x(T) = within an unspecified bounded interval [0,T]. 
Functionals to be minimized are 

i-T fT 



h= I dt, h = [ \u(t)\dt. 
Jo Jo 



Applying the Pontryagin maximum principle |15j we obtain: 

Si = {(x(t),u(t)) : u(t) = -sgn{£_}} , min [ dt = |£| . 

Jo 

and 

S 2 = {(x(t),u(t)) : u(t) - -sgn{£}v(t)}, 

where 

v(t) E V = {v(t) : < v(t) <l,te [Q,T\,v(t) ^ 0}, min [ \-sgn{£}v{t)\dt = \£\ 

Jo 

Details can be found in It is easy to see that Si S2 — Si (we can take 
v(t) = 1, t € [0,T]). In this problem we have: Si = = S% C S 2 - Hence I 2 
is nonessential, but Ii is essential (in order to see this we need only to change 
indices) . 

Lemma 3.3. One has S^ C S^ +1 if, and only if, for every (x, u) G S^ the 
following condition holds: 

3{x',u') G S : I N [x',u'} = I N [x,u] =J> I N+1 [x',u'] = I N+1 [x,u] . 
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Proof. Let S§ C S^ +1 and assume, on the contrary, that exists (x,u) £ 
such that 

3{x',u') £S:I N [x',u'}=I N [x,u} (3.1) 

and 

I N+ i[x',u'} ^ I N+ i[x,u]. (3.2) 

We conclude from JOJ that (x',it') € . Therefore (x',u') is not in 5^ +1 
or (x,u) is not in S^ +1 by This contradicts the fact that S§ C S§ +1 . 

Let us prove now the second implication. If S% = 0, then C Sg +1 . Let 
Sjj 7^ 0. Suppose that for every (x,u) £ S^f holds: 

3(x', u') € S : I N [x' , u'] = / [a;, u] /jv+i u'] = 2at+i [x, u] (3-3) 

and is not contained in Sg +1 . In this case there exists (x,u) in S§ which 
is not in Sg +1 . Hence 

3(x, u) £ S : I N+1 [x, u] ^ I Ar+1 [5, u] . (3.4) 

This gives I N [x,u] = I [x, u] and from (|3.3() we have In+i[x,u] = In+i[x,u]. 
Consequently I N+1 [x,u] = I + [x,u], contrary to l|3.4[l . □ 

Remark 3.4. Notice that in Example 13 . 21 the scalar optimal control problem 

min/i[x,u] 

subject to S has a unique solution. Therefore, Lemma 13.31 holds true for the 
example. 

Definition 3.5. A function / : M — > M is nondecreasing if for y 1 and y 2 £ R w : 
y 1 <. y 2 imply /(y 1 ) < f(y 2 ). 

Theorem 3.6. If I N+1 [x, u] = f(I N [x,u}), where f : R N -> R 7 then Sf C 
S'^ r+1 . Furthermore, SS — S^ +1 if function f is nondecreasing on the set 
I N {S). 

Proof. Let (x,u) £ S%. If there exists (x',u') £ S such that I N [x',u'] = 
I N [x,u], then f(I N [x',u'}) — f(I N [x,u]) and so In+i[x' ,u'] — Ijy + i{x,u]. 
Therefore S% C S^ +1 by Lemma IO 

We will now show the inclusion S^ +1 C . Let (x,u) £ S, (x,u) be- 
ing not an element of the set . In this case there exists (x',u') £ S such 
that I N [x',u'] ^ I N [x,u). If / is nondecreasing on I N (S), we know that 
Iff+i[x',u'] = f(I N [x',u'}) < f(I N [x,u]) — In+i[x,u}. Hence (x,u) is not 
an element of the set S^ +1 . □ 

Remark 3.7. Example 13.21 shows that sufficient condition in Theorem 13.61 for 
an optimal control functional to be nonessential, is not necessary. 



Theorem 3.8. Let S N +i = {(x°,u° )}. If the functional In +i is nonessential, 

yN 



then (x°,u°) £ S% 
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Proof. Let S% = S^ +1 . If (x°, u°) is not an element of the set Sf , then (a; , zt°) 
is also not an element of the set Sg +1 . In this case, there exists (x',u') 6 S* 
such that 7 Ar+1 [x',w'] ^ J Ar + 1 [x°,u ]. So | y+ i[jb',u / ] < I N+1 [x°,U ]. This is a 
contradiction to the assumption that Sn+i — {{ x ° > u °)}- D 

Theorem 3.9. Let the set S be compact. If the functional In+i is nonessential, 
then S N+1 n S§ ^ 0. 

Proof. Consider the problem 

min f f(t,x{t),u(t))dt (3.5) 

J a 

subject to Sjv+i- Let S denote the set of efficient solutions of the problem 
1)3. 5|l . By the compactness of the set S, the set S 1 is nonempty. Let (x°,u a ) G 
S*. If (x°,w°) is not an element of Sg , then by assumption (x°,u°) is not an 
element of Sg +1 . In this case, there exists (x',u') £ S such that 7 A ' +1 [x',u'] ^ 
7 Ar+1 [.x°, m ]. Hence (x',u') E Sjv+i< This contradicts the fact that (a;°,u°) is 
an efficient solution of the problem l|3.5l) . □ 

Remark 3.10. Notice that I2 is nonessential in Example 13.21 and we have fl 

Next section provides an example of application of the obtained results to 
check whether a functional is nonessential. 



4 An illustrative example 

We illustrate the obtained results with a multiobjective control problem bor- 
rowed from [17, §4.3], where N = 3, n = 2, r = 1, m = 4, a = 0, b = T, with T 
not fixed. We consider a mobile rocket car with mass one running on rails on 
a closed region —3 < X\ < 3 (we denote the position of the center of the car at 
time t by X\(t)), whose movement we can control with its accelerator u, where 
the maximum allowable acceleration is 1 and the maximum break power is — 1, 
i.e., — 1 < u < 1 (negative force means break, positive force means acceleration). 
The dynamics of the system is given by Newton's second law, force equals mass 
times acceleration, which in our setting reads as u(t) = x\(t). The problem is to 
move the car from a given location to a pre-assigned destination. If the car is at 
a position x\ = 1 at time t = 0, with no velocity, that is ii(0) = 0, we want to 
find a piecewise constant function u{t) that drives the car to X\(T) — at some 
instant T > 0. The state of the system is given by the position x\{t) and the 
velocity x%{t) = ii(t) (where we are and how fast we are going at each instant 
of time f). Different cost criteria can be considered, for example, minimizing the 
time T (functional I\ below); maximizing the velocity at T (maximizing x%(T), 
which corresponds to functional I2 below); and a linear combination ^3 of these 
functionals: minimize 

h = [ Idt, I 2 = / -u(t)dt , h = h+I 2 , 
Jo Jo 
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subject to the control system 




(4.1) 



to the boundary conditions 

a;i(0) = 1, x 1 (T) = 0, x 2 (0) = 0; (4.2) 



and inequality constraints 



M<1, N<3. (4.3) 



Denoting by Si, i = 1, 2, 3, the solution set of the scalar optimal control problem 
mmli[x,u] subject to l|4.1|l - (|4.3|) . we have:* Si = {(x 1 ^ 1 )} with 

u 1 = -1 , 
x 1 = — + 1 , x 2 = —t , 



S 2 = {(x 2 ,u 2 )} with 



u 2 



< t < T = V2; 



-1 if < £ < 2 , 

-1 if2<t<T = 4 + V6, 





if < 


t < 


■(:: 


if 1 < 


t < 


if < t 


< 1, 


x 2 ■ 


if 1 <t 


<2, 



2_j-|- + l if < i < 2 , 2 _\-t if < * < 2 , 

Xl ~\tj-4t + 5 if2<t<4 + V6, X2 ~\t-4 if2<<<4 + \/6; 

S 3 = {(x 3 ,u 3 )} with 

u 3 

3 _f-f + l ifO<t<l, 2 _ J — t if < i < 1 , 

Xl |^-2< + 2 if 1 < t < 2 , ^ [t-2 if 1 < i < 2 . 

Direct calculations show that 

/ 2 [a; 2 ,u 2 ] = [4 + V6,-V6] =B, 
I 2 [x 3 ,u 3 } = [2,0] = C. 

Let £ denote the set S^. It is the continuous, convex curve AB (details can be 
found in [T71 §4.3]). As C € ( we have S% n S 3 ^ 0. Moreover, let us notice 
that J3 has a form I 3 [x, u] — f(I 2 [x,u]), where / : K 2 — * K is nondecreasing 
function. Therefore, the functional .Z3 is nonessential by Theorem 13.61 

*The solutions to the scalar optimal control problems Ii[x, u] — * min are found by appli- 
cation of the Pontryagin maximum principle 1151 . Details can be found in 1171 §4.3]. 
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Remark 4.1. If we change the functional I3 into 



I 3 [x,u] = 71J1 [a;, u] + 72-^2 fo"]) 



(4.4) 



where 7$ € R and 7^ > 0, ? = 1, 2 or 



I 3 [x, «] = [ar, u] - y/2)' + (J 2 [x, u] + V6) p ] * , 



(4.5) 



where p £ [1, 00], then again ^3 will be nonessential by Theorem 13. 61 It is worth 
noting that functionals l|4.4|) and 14. 5|) can be used in order to find efficient 
solutions of the problem mml 2 [x, u] subject to l|4.1|) - (|4.3[) . We mentioned this 
in section 2, details can be found in ^7] and 

5 Conclusions 

The problem of optimizing a vector-valued criteria often arises in connection 
with the solution of problems in the areas of planning, organization of produc- 
tion, operational research and dynamical control systems. Currently, the prob- 
lem of optimizing a vector- valued criteria is a central part of control theory and 
great attention is being given to it in the design and construction of modern au- 
tomatic control systems, such as in concrete applications of seismology, energetic 
chemistry and metallurgy. In this work we use the notion of Pareto-optimality 
in control theory to define and investigate nonessential objective functionals of 
optimal control. For multicriteria optimal control systems this notion seems to 
be new and not used before. We claim the concept of nonessential objective 
functional to be an important issue in optimal control and we trust it will have 
an important role in the study of vector- valued optimization problems of control 
theory. For future work, it would be interesting to study the consequences of 
dropping nonessential objectives in multi-criteria optimal control systems. 
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